Some remarks on Renyi relative entropy in a thermostatistical framework 
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In ordinary Boltzmann-Gibbs thermostatistics, the relative entropy expression plays the role of 
generalized free energy, providing the difference between the off-equilibrium and equilibrium free 
energy terms associated with Boltzmann-Gibbs entropy. In this context, we studied whether this 
physical meaning can be given to Renyi relative entropy definition found in the literature from a 
generalized thermostatistical point of view. We find that this is possible only in the limit as q 
approaches to 1. This shows that Renyi relative entropy has a physical (thermostatistical) meaning 
only when the system can already be explained by ordinary Boltzmann-Gibbs thermostatistics. 
Moreover, this can be taken as an indication of Renyi entropy being an equilibrium entropy since 
any relative entropy definition is a two-probability generalization of the associated entropy definition. 
We also note that this result is independent of the internal energy constraint employed. Finally, 
we comment on the lack of foundation of Renyi relative entropy as far as its minimization (which 
is equivalent to the maximization of Renyi entropy) is considered in order to obtain a stationary 
equilibrium distribution since Renyi relative entropy does not conform to Shore- Johnson axioms. 
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I. INTRODUCTION 



Recently there has been a growing interest in general- 
ized entropies such as Tsallis [1], Renyi [2] and Sharma- 
Mittal [3] entropies in the context of a generalized ther- 
mostatistics. Although Renyi entropy has been intro- 
duced by A. Renyi as early as 1961, the applications of 
this form of entropy have been for example in the fields of 
quantum computation [4], information theory [5, 6] and 
chaotic one-dimensional maps [7]. Only recently, some 
authors have studied Renyi entropy in the framework of 
a generalized thermostatistics [8-12]. Lenzi et al. [8] 
and Bashkirov [11] for example showed that it results 
in a power-law equilibrium distribution by maximization 
whereas Parvan and Biro [12] concluded that Renyi en- 
tropy also satisfies zcroth law of thermodynamics. In this 
Letter, we will focus on the physical meaning of Renyi rel- 
ative entropy (also called divergence or cross-entropy) in 
the framework of a generalized thermostatistics. Before 
proceeding further, it is important to assess the impor- 
tance of relative entropy in entropy maximization related 
issues and in thermostatistics in general. For this purpose, 
let us write Boltzmann-Gibbs (BG) entropy which reads 



w 



Sbg{p) = - ^Pi^npi, 



(1) 



where pi is the probability of the system in the ith 
microstate, W is the total number of the configurations 



of the system. Note that Boltzmann constant k is set to 
unity throughout the paper. The corresponding relative 
entropy is called KuUback-Leibler entropy (K-L) [13] and 
it is given by 



K[p\\q] = ^Piln{p,/q 



(2) 
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Note that it is a convex function of pi, always non- 
negative and equal to zero if and only if p = q. The 
probabilities g^'s are called prior or reference distribu- 
tions. K-L entropy can be thought as a generalization 
of BG entropy in the sense that both are equal to one 
another, apart from a multiplicative constant, when the 
prior distribution in relative entropy definition is known 
with certainty i.e., a probability of one is assigned to it. 
Therefore, it is always possible to obtain BG entropy as 
a particular case of corresponding relative entropy ex- 
pression, so called K-L entropy. The converse is not true 
since K-L relative entropy is a two-probability distribu- 
tion generalization of BG entropy. This situation can be 
compared to the case of Renyi and BG entropies: Renyi 
entropy is considered to be a generalization of BG en- 
tropy simply due to the fact that its parameter can be 
adjusted in such a way that it results in BG entropy as 
a particular case. Whenever the Renyi index q becomes 
1, we obtain BG entropy as a particular case. In this 
sense, any relative entropy definition associated with a 
particular entropy, be it Renyi or Tsallis entropies, is a 
generalization of that particular entropy in terms of prob- 
abilities whereas generalized entropies such as Renyi or 
Tsallis entropies are seen to be generalization in terms of 
some parameter q although the nature of this parameter 
is not the same in these aforementioned cases. Second 
issue regarding the importance of the concept of rela- 
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tivc entropy is that ordinary BG entropy cannot be gen- 
eralized to continuum rigorously just by changing sum- 
mation to integration since it fails to be invariant un- 
der different parametrizations. Moreover, it will not be 
bounded neither from below nor above (see Ref.[14] and 
references therein). Contrary to these problems with or- 
dinary BG entropy in its generalization to the continuum 
case, the relative entropy definition does not face any of 
these problems. Therefore, relative entropy is more gen- 
eral in its domain of applicability since it can be used in 
the continuum case unlike ordinary BG entropy. All of 
the remarks above can be summarized by the statement 
that the concept of relative entropy is a generalization 
of the corresponding entropy definition both in terms of 
probability distributions and continuum case. It is our 
aim in this paper to present some results related to the 
definition of Renyi relative entropy concerning its physi- 
cal meaning and relation to internal energy constraints. 
But since Renyi relative entropy is understood to be a 
generalization of Renyi entropy, what can be said about 
Renyi relative entropy has important bearings on Renyi 
entropy itself. In addition to these important features 
of relative entropy in a thermostatistical framework, it 
is also an important measure of complexity whose uses 
range from the numerical analysis of protein sequences 
[15], pricing models in the market [16], to medical deci- 
sion making [17]. The outline of the Letter is as follows: 
In the next Section, we revisit the physical meaning of 
the ordinary relative entropy in the case of BG entropy. 
We then study Renyi relative entropy in a thermostatis- 
tical framework in Section III. Section IV will be devoted 
to the study of the axiomatic foundation of Renyi relative 
entropy. The conclusions will be discussed in Section V. 



Equating the derivative of the functional to zero, we ob- 
tain 



Spi 



■ Inpi — 1 — a — Pei = 0. 



(4) 



Tilde denotes the equilibrium distribution obtained by 
the maximization of BG entropy. By multiplying Eq. (4) 
by Pi and summing over i, using the normalization and 
internal energy constraints, we have 



i + l = Sbg- PU. 



(5) 



Substitution of Eq. (5) into Eq. (4) results in the 
following equilibrium distribution 



(6) 



If we now use the equilibrium distribution p as the 
reference distribution in K-L entropy, we can write 

K\p\\p\=J2pMPi/Pi)- (7) 

i 

The equation above can be rewritten as 



(8) 



We then insert the equilibrium distribution given by 
Eq. (6) in the equation above to find 



II. PHYSICAL MEANING OF 
KULLBACK-LEIBLER RELATIVE ENTROPY 



K[p\\p\ = -Sbg - ^Pz(-5bg + PU- psi). (9) 

i 

Carrying out the summation, we have 



In order to study the physical meaning of any relative 
entropy in a thermostatistical framework, one has first 
to obtain the equilibrium distribution associated with 
the entropy of that particular thermostatistics. In this 
Section, we will maximize BG entropy subject to some 
constraints following the well known recipe of entropy 
maximization. Let us assume that the internal energy 
function is given hy U = ^iPi ; where e,; denotes the 

i 

energy of the ith microstate. In order to get the equilib- 
rium distribution associated with BG entropy, we maxi- 
mize the following functional 

W WW 

Hp) = -^P^^^Pi- Oi^Pt- f^JZ^iP'^ 
i i i 

where a and /3 are Lagrange multipliers related to nor- 
malization and internal energy constraints respectively. 



K[p\\p\ = -SBG + SBG-f3U + f3U, (10) 
which can be cast into the form 

K[p\\p\ = I3{Fbg - Fbg)- (11) 

The free energy term is given as usual by F = U — 
Sbg/I3- The result above shows us that the physical 
meaning of the K-L entropy is nothing but the difference 
of the off-equilibrium and equilibrium free energies when 
the reference distribution is taken to be the equilibrium 
distribution given by Eq. (6) above. This result can be 
used, for example, to study equilibrium fluctuations or 
non-equilibrium relaxation of polymer chains [18] . 
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III. RENYI RELATIVE ENTROPY AS A 
GENERALIZED FREE ENERGY 

After studying the physical meaning of K-L entropy 
in the previous Section, we are now ready to study the 
meaning of Renyi relative entropy in generalized thermo- 
statistical framework. In order to do this, we begin by 
writing Renyi entropy [2] 



Snip) = Y^MT^pD, 



(12) 



where the parameter q is an arbitrary real number. Renyi 
entropy is equal to or greater than zero for all values of 
the parameter q and concave for g < 1. It reduces to 
BG entropy given by Eq. (1) as the parameter q ap- 
proaches 1. Using internal energy constraint in terms of 

escort probabilities i.e., Ug = '^^^ , the functional to be 



maximized reads 



w 

iip) = Y^MY.p^)-^Y.p^-^^^- (13) 



w 



We take the derivative of this functional and equate it 
to zero in order to obtain the following 



a-/3*#«-i(£i-C/g) =0, (14) 



where /3* is given by 



13* 



Eg 



(15) 



Multiplying the equation above by Pi and summing 
over the index i, we find 



a 



1-q 



(16) 



Note that tilde denotes that the distribution is calcu- 
lated at equilibrium. Substituting this explicit expression 
of a into Eq. (14), we calculate the explicit form of equi- 
librium distribution . It reads 



The Renyi relative entropy [19] reads 

lMr] = -^Hj2P>l~'')- (18) 



This definition of Renyi relative entropy too is always 
non-negative and equal to zero if and only if p = r. It also 
reduces to K-L entropy as the parameter q approaches 1. 
We then substitute equilibrium distribution in Eq. (17) 
into the relative entropy definition above and obtain 

IMp\ = ^ln(^pf((-^^^-(l-9)/3*(e,-C/,)))). 

(19) 

Having summed up over indices, we obtain 

IMp\ = -l^Me^i-'')^^^-^^) - (1 - qW*{Ug - U,)), 

(20) 

where /?** is given by 



13* 



E?^ 



(21) 



Inspection of Eq. (20) shows that one cannot cast it 
into the form of free energy differences associated with 
Renyi-related quantities due to the logarithmic term in- 
volved. Indeed, one needs to apply Taylor expansion two 
times, first to the exponential term in the parentheses 
and second to the logarithmic term itself. Having made 
these two Taylor series expansions about q= 1, we finally 
arrive a familiar result i.e., 



IM\P\ = 0{Pbg - Fbg), 



(22) 



where free energy expressions are exactly the same as 
in the BG case. This result is trivial and equal to the ex- 
pression obtained in Section II by using BG entropy and 
K-L entropy. It should be noted that the first Taylor ex- 
pansion turned the Renyi entropy into BG entropy while 
second Taylor expansion turned the Lagrange multiplier 
and internal energy functions into their corresponding 
BG values. 

It is important to underline one crucial point: we have 
maximized Renyi entropy with escort distribution and 
used this equilibrium distribution as the reference dis- 
tribution for the associated relative entropy expression. 
However, if we try to maximize it with ordinary con- 
straint, then we obtain 



Pi 



[[1- p'LA^e,-U,))Y,^r^'-'^. (23) 



for the equilibrium distribution. It is obvious that the 
substitution of Eq. (23) into relative entropy expression 
given by Eq. (18) does not yield to a result which can 
be written as difference of free energies for all q values. 
Again, the relative entropy will be a generalized free en- 
ergy only in the limit as q approaches 1 . This shows that 
the choice of internal energy constraint does not matter 
at all in assessing the physical meaning of Renyi relative 
entropy. 
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IV. AXIOMATIC FOUNDATION OF RENYI 
RELATIVE ENTROPY 

The stationary equilibrium distribution associated 
with a particular entropy expression can be found either 
by the maximization of that entropy or the minimiza- 
tion of the corresponding relative entropy. In this sense, 
it is expected both of these methods to be consistent 
and well-founded in terms of axioms. Shore and Johnson 
considered the axioms, which must be satisfied by any 
relative entropy expression if they were expected to lead 
to minimum relative entropy for the stationary equilib- 
rium distribution in a consistent manner [20, 21]. These 
axioms are given by 

1. Axiom of Uniqueness: If the same problem is solved 
twice, then the same answer is expected to result 
both times. 

2. Axiom of Invariance: The same answer is expected 
when the same problem is solved in two different 
coordinate systems, in which the posteriors in the 
two systems should be related by the coordinate 
transformation. 

3. Axiom of System Independence: It should not mat- 
ter whether one accounts for independent informa- 
tion about independent systems separately in terms 
of their marginal distributions or in terms of the 
joint distribution. 

4. Axiom of Subset Independence: It should not mat- 
ter whether one treats independent subsets of the 

states of the systems in terms of their separate con- 
ditional distributions or in terms of the joint distri- 
bution. 

5. Axiom of Expansibility: In the absence of new in- 
formation, the prior should not be changed. 

These authors were able to show that the satisfaction 
of all these axioms resulted in a relative entropy expres- 
sion consistent with the principle of minimum relative 
entropy and could be summarized in one simple expres- 
sion: according to Shore and Johnson, any relative en- 
tropy with the prior and posterior pi which 
satisfies five very general axioms, must be of the form 

J[p||r] =^p,/ife/ri), (24) 

i 

for some function h{x). Ordinary relative entropy i.e., 
K-L entropy is in accordance with Shore-Johnson theo- 
rem since the function h{x) can be identified as the natu- 
ral logarithm. In the case of Renyi relative entropy given 
by Eq. (18), we see that it cannot be cast into a form 
which will conform to the Shore- Johnson theorem for any 
function h{x). In other words, there is no axiomatic basis 
for the use of Renyi relative entropy in order to get the 
stationary equilibrium distribution for a possible gener- 
alized thermostatistics. 



V. CONCLUSIONS 

The relative entropy acts as a generalized free energy 
in the ordinary thermostatistical framework when one 
makes use of the associated equilibrium distribution as 
the reference distribution. In this Letter, we investigated 
whether Renyi relative entropy can play the role of a 
generalized free energy in a thermostatistical framework. 
We found that this is possible only in the limit as q ap- 
proaches to 1. This shows that Renyi relative entropy 
has a thermostatistical meaning only when the system is 
in a state of ordinary BG thermostatistics. This can be 
taken as an indication of Renyi entropy being an equi- 
librium entropy and nothing but an approximation to 
ordinary BG thermostatistics since any relative entropy 
definition is a two-probability generalization of the asso- 
ciated entropy definition. The choice of internal energy 
constraint too does not solve the problem. Still, relative 
entropy acts as a generalized free energy only in the q=l 
limit. This is different than the case of BG or Tsallis 
entropy [21]. In Tsallis case in particular, one docs not 
need to make any approximation, which in turn makes 
the physical interpretation valid for all positive q val- 
ues. This is reminiscent of the fact that Renyi entropy 
provides the same answer at the microcanonical struc- 
ture as BG entropy, yielding InW [22]. As Renyi entropy 
yields the same result as BG entropy in the microcanon- 
ical case, so does Renyi relative entropy in its connection 
to free energies. In other words, it is redundant to use 
Renyi entropy in the microcanonical case and it is so to 
use Renyi relative entropies in calculating nonequilibrium 
fluctuations of polymer chains since we already have K- 
L entropy for this purpose [18]. These results regarding 
the physical meaning of Renyi relative entropy are simi- 
lar to the results derived from Lesche stability condition 
[23] for Renyi entropy since both considers deformation 
of probabilities and concludes Renyi entropy makes sense 
only in the limit when q approaches 1 in which case it 
becomes BG entropy (corresponding relative entropy be- 
comes K-L cintropy). Lastly, it can be noted that the 
results presented in this paper are also supported by the 
original methodology of orthodes devised by Boltzmann 
when applied to Renyi entropy since it leads one to de- 
duce that Renyi entropy is an equilibrium entropy [24]. 
It is interesting to note that this result has also been 
reached independently in Ref. [25] by using a different 
method than the method of orthodes employed in Ref. 
[24] thereby making this view even stronger. Our ap- 
proach to this issue explains one more difficulty arising 
from the comparison of the works of Refs. [24] and [25] 
since in the former escort distribution has been employed 
whereas ordinary constraint has been used in the latter. 
In our view, it is not surprising that the same conclu- 
sion has been reached concerning Renyi entropy being 
an equilibrium entropy since associated relative entropy 
possesses a physical meaning in both cases only when 
the parameter q approaches 1, thereby making the differ- 
ence in employed constraints redundant. Apart from the 
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verification of this result, it can be noted that the nov- 
elty here is the understanding of this entropy to be an 
approximation to the ordinary BG entropy in the ther- 
mostatistical framework in a generalized setting of the 
definition of corresponding relative entropy. Lastly, we 
have shown that Renyi relative entropy does not have a 
sound axiomatic foundation since it does not conform to 
Shore-Johnson axioms. Therefore, any attempt to min- 



imize Renyi relative entropy in order to obtain an asso- 
ciated stationary equilibrium distribution in the context 
of generalized thermostatistics fails to be consistent. 
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